Excuse Me? You Don't Tell Me What to Do